Frame interpolation using transmitted block-based motion vectors

The proposed technique is designed for interpolating video frames often dropped during compression using standards, such as MPEG-4 and H.263 at very low bit rates. The coarse motion vector field is refined at the receiving side using mesh-based motion estimation instead of using computationally intensive dense motion estimation. We propose a framework for detecting and utilizing local motion boundaries in terms of an explicit model. Motion boundaries are modeled using edge detection and Hough transform. The motion of the occluding side is represented by affine mapping. The newly appearing region is also detected. Each pixel is interpolated differently according to adaptive interpolation based on the property of the pixel: moving, static, and disoccluded.